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Abstract 

This  document  is  the  result  of  a  joint  effort  to  understand  what  are  relevant  factors  to  consider  when 
there  are  several  possible  courses  of  action  (COAs)  to  accomplish  a  Non-^combatant  Evacuation  Operation 
(NEO)  military  mission.  These  relevant  factors  are  useful  for  generation  and  evaluation  of  COAs  and 
provide  the  basis  for  a  good  decision  in  selecting  a  COA.  The  document  compiles  the  relevant  factors  from 
the  perspective  of  logistics  that  are  useful  to  evaluate  whether  or  not  alternative  proposed  COAs  can  be 
supported  logistically,  and  which  ones  seem  to  be  better  alternatives  compared  to  the  others.  The  ultimate 
goal  of  this  joint  effort  is  to  use  these  factors  to  automate  the  evaluation  and  comparison  of  COAs  and  use 
the  comparison  to  determine  what  are  critical  aspects  cf  a  COA  that  may  be  changed  to  produce  a  better 
option  with  a  generative  planner.  We  d'seuss  how  we  envision  using  expect  and  0-Plan2  for  this  purpose. 


Keywords:  EXPECT,  0-Plan2,  evaluation,  Course  of  Action  evaluation,  PRECiS. 
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1  Introduction 


Generating  qualitatively  diflerent  plans  is  crucial  in  decision-making  support  systems  within  the  Planning 
Initiative.  Current  planners  are  tasked  such  that  all  the  alternative  COAs  generated  are  pretty  much  pro¬ 
duced  under  some  fijced  patterns.  Typical  patterns  Me  to  prod  ce  one  COA  that  uses  many  resources  but 
can  be  deployed  very  fast,  another  that  uses  less  resources  aiid  the  deployment  takes  longer,  another  is 
somewhere  in  the  middle,  and  another  is  a  bit  more  extreme.  Generating  qualitatively  different  plans  would 
allow  more  VMiety  and  better  quality  solutions. 

What  we  foresee  as  the  framework  is  that  an  outer  “strategic/task  assignment”  layer  of  the  system 
performs  some  task  analysis  and  seta  direction.  This  would  be  used  to  set  up  definite  targets  and  constraints 
for  the  "tactical”  planner  to  flesh  out.  The  tactics  planner  would  thus  establish  that  a  plan  was  possible 
within  the  framework  specified  (keeping  certain  elements  of  evaluation  at  favorable  levels).  The  planner  would 
be  tasked  with  different  such  requirements  to  produce  alternate  plans  which  are  qualitatively  different. 

The  intent  of  this  document  is  to  add  to  the  PRECiS  domain  description  [6]  such  that  together  they 
provide  a  rich  domain  example  that  is  simple  enough  for  enabling  technology  research,  but  also  that  can  be 
realistically  evaluated  and  recognised  as  addressing  real  issues. 

This  document  attempts  to  ciMify  the  following  issues: 

1.  CleM  sepMation  of  iaak  assignment  and  scoping  of  a  request  to  a  tactical  planner.  Why  these  differ 
and  how  it  helps  to  cleMly  sepMate  the  two. 

2.  Need  for  criteria  against  which  plans  will  be  evaluated.  Idea  that  the  same  criteria  can  be  used  to 
direct  the  planner  from  the  task  assigner  and  can  also  be  used  to  evaluate  alternatives  produced. 

Our  main  goals  mc  the  following: 

•  To  understand  how  domain  criteria  will  be  used  to  evaluate  a  plan  however  it  was  prodneed  -  manuallg, 
aatomaticallg  or  wtik  mixed  initiative. 

•  To  relate  each  of  these  domain  criteria  to  plan  features  in  order  to  ensure  that  these  plan  features  can 
be  reasoned  about  by  future  planners. 

•  To  give  feedback  to  plan  representation  design  efforts,  to  'ndicate  which  parts  of  the  KRSL  plan 
representation  should  be  the  primary  tMgets  for  our  work  as  being  most  relevant  to  domain  issues  of 
concern. 

•  To  design  an  evaluation  function  to  rate  plan  alternatives  which  will  guide  alternatives  selection,  such 
that  the  planner  is  using  the  same  knowledge  in  choice  making  that  will  be  used  to  rate  COA  options 
by  the  higher  level  analysis  and  direction  people. 

•  To  influence  planner  design  and  features  to  ensure  that  support  is  available  to  generate  plans  « 
desirable  domain  features  required. 

This  document  runs  as  follows.  After  laying  some  background  on  the  purpose  of  COA  evaluations,  the 
paper  shows  the  evaluation  factors  relevant  for  NEO  operations.  We  then  describe  in  detail  how  to  evaluate 
relevant  factors  from  a  logistics  perspective.  Finally,  we  discuss  how  the  O  Plan2  and  EXPECT  systems  can 
cooperate  in  the  generation  and  evaluation  of  alternative  courses  of  action.  The  paper  includes  appendices 
with  concrete  examples  of  how  tentative  COAs  are  described,  evaluated,  and  compared. 


2  Background 


During  the  concept  development  phase  of  a  plan,  it  is  crucial  to  develop  careful  estimates  of  the  situation 

and  the  alternative  courses  of  action.  This  analysis  can  help  in  making  certain  that; 

a)  a  broad  spectrum  of  possible  courses  of  action  is  considered; 

b)  the  uncertainties  in  each  COA  are  analyzed  and  estimated  to  reduce  unknowns; 

c)  the  analysis  can  be  used  as  the  basis  for  a  commander’s  estimate  and  subsequent  selection  of  the  appro¬ 

priate  options. 

The  concept  development  phase  is  composed  of  the  following  steps  [ll]: 

1.  Mission  Analysis.  The  CINC  analyzes  the  mission  and  the  assigned  task.  The  result  is  a  mission 
siaiement  that  contains  the  tasks  to  be  accomplished  and  the  purpose  they  achieve.  These  tasks  are 
described  by  who/what/when/where/why/how. 

2.  Planning  Guidance.  The  supported  commander  produces  a  planning  directive,  that  contains  several 
tentative  courses  of  action  and  other  information  that  is  used  as  initial  guidance  for  the  analyses.  Each 
tentative  COA  is  described  as  a  scries  of  elements  cximposed  of  who/when/what/where. 

3.  Staff  Estimates.  The  six  staff  divisions  use  the  planning  directive  to  analyze  the  situation,  each  one 
from  a  different  perspective.  J-1  is  concerned  with  personnel,  J-2  with  intelligence,  J-3  with  operations, 
J*4  with  logistics,  J-5  with  plans  and  policy,  and  J-6  is  concerned  with  C^.  The  result  of  this  analysis 
is  a  more  refined  description  of  each  tentative  COA,  as  well  as  staff  estimates  of  relevant  factors. 

4.  Commander’s  Estimate.  A  commander’s  estimate  that  summarizes  the  staff  estimates  is  put  together 
that  is  the  basis  to  select  one  of  the  tentative  COAs. 

6.  Concept  of  Operations.  Produce  an  OPLAN  (operation  plan)  that  fully  develops  the  CINC’e  concept 
of  operations  and  includes  time-phased  force  and  deployment  data  (TPFDD). 

The  preparation  of  the  staff  estimates  and  the  commander’s  estimate  may  be  the  most  critical  and  time 
consuming  task  of  time-sensitive  planning  operations.  This  is  currently  done  by  human  planners,  and  our 
goal  is  to  contribute  to  the  automation  (or  partial  automation)  of  this  process. 

Another  important  problem  is  that  the  generation  of  alternative  courses  of  action  cannot  be  fine-tuned 
because  of  time  constraints.  Courses  of  action  turn  out  to  be  one  of  three  types  [I2]: 

1.  conservative,  using  few  forces, 

2.  use  massive  forces, 

3.  take  little  force  with  the  hope  th* '  lite  -peratiori  will  succeed  anyway. 

These  three  types  sue  too  gross  grain  and  lie  on  stereotypical  positions  of  the  spectrum  of  possible 
alternatives.  There  are  many  tradeoffs  that  should  be  considered.  For  example,  using  a  large  force  is  a 
trivial  way  to  make  an  operation  succeed.  However,  such  COA  is  considered  unacceptable  because  it  is  too 
expensive.  The  goal  is  to  use  the  minimum  amount  of  force  sufficient  to  hold  the  operation  and  of  acceptable 
cost.  If  we  increase  automation  during  this  phase,  more  satisfactory  COAa  will  be  produced 
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3  Evaluation  Factors  for  NEO  Operations 

In  the  staff  estimates  process,  23  of  the  39  JOPES  identified  elements  of  evaluation  (EEs)  [lO]  are  applicable 
to  most  NEO  operations  and  should  therefore  be  considered  in  the  identification  and  recommendation  of  a 
NEO  COA.  Of  these  factors,  mamy  will  remain  constant  across  all  COAs  and  are  usually  not  addressed.  Of 
those  that  differ,  a  few  are  identified  as  critical  factors  tmd  are  thus  instrumental  in  the  nomination  of  the 
recommended  COA. 

The  23  EEld  are: 

1.  Agreements  and  treaties 

Do  we  have  overflight  rights  and  freedom  of  navigation  for  all  lines  of  communications? 

Do  we  have  basing  rights  for  aU  staging  bases,  intermediate  locations,  and  safe  havens? 

E)o  we  have  all  necessary  host  nation  support  at  each  location? 

Would  we  be  violating  any  treaties  with  any  country  involved  while  conducting  the  proposed  activities? 

2.  Airfields  and  air  facilities 

Are  the  airfields  close  to  the  evacuation  areas? 

Are  the  airfields  capable  of  supporting  the  proposed  evacuation  aircraft  type*)? 

Are  the  airfields  capable  of  supporting  the  proposed  aircraft  quantities? 

Arc  there  enough  of  the  right  types  of  staff  available  (refuelers,  air  traffic  control,  maintenance,  etc.)? 
Do  the  airfields  have  facilities  for  refueling  (only  if  necessary)  or  do  wc  need  to  bring  it  in? 

Are  the  airfields  capable  of  providing  the  equipment  necessary  to  support  aircraft  operations  (radios, 
radar,  etc.)? 

Do  the  airfields  have  maintenance  facilities  (hardstands,  hangars,  etc.)  if  maintenance  is  going  to  be 
needed  there? 

3.  Allied  and  friendly  cooperation 

Is  this  a  joint  operation?  If  so,  have  tasks/miasions  been  allocated? 

Eh)  we  have  the  political  backing  of  our  friends  and  allies  for  this  operation? 

4.  American  .firms  overseas 

Are  there  firms  that  will  require  staff  and  essential  records/equipment  evacuation? 

5.  Ammsnition 

Do  we  have  access  to  sufficient  quantities? 

Do  we  have  access  to  sufficient  types? 

Can  we  acquire  the  ammunition  in  a  timely  manner  to  support  operations'^ 

Are  we  prepared  for  contingencies  with  respect  to  needed  ammunition? 

6.  Communications 

Will  the  Host  Nation  communications  be  sufficient  (phones)? 

Do  we  need  secure  communications?  If  »o,  can  we  provide  it? 
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7.  Concept  of  operations 

Is  the  concept  of  operations  in  accordance  with  all  guidance  and  constraints  currently  supplied? 
is  the  concept  robust  (no/minimal  single  point  failure)? 

Is  the  concept  flexible  (is  this  option  able  to  adapt  to  worsening  /  improving  conditions)? 

Are  the  success,  termination,  and  transition  criteria  well  defined? 

8.  Effects  of  US  response 

Will  there  be  repercussions  based  on  our  response  (sanctions,  diplomatic  relations,  etc.)? 

Will  the  American  people  support  the  operation? 

9.  Environment,  weather,  and  oceanography 

Can  critical  portions  of  the  operation  be  done  at  night? 

Will  weather  potentially  hamper  /  delay  our  operation? 

Can  the  weather  be  used  to  hamper  /  delay  enemy  activities  /  reaction? 

Do  the  tides  negatively  affect  the  operation? 

10.  FaciliUes  (US  and  allied) 

Are  allied  and  US  facilities  sufflcient  to  support  operations? 

Intermediate  locations;  food,  wcter,  shelter,  safety? 

Safe  Havens;  food,  water,  shelter,  hospital,  political,  onward  transportation? 

11.  Facilities  (enemy) 

Are  enemy  facilities  a  “center  of  gravity”  for  their  operations?  Can  they  be  disabled? 

Can  enemy  facilities  be  captured  /  utilized  for  our  benefit? 

12.  Forces  (US  and  allied) 

Are  the  forces  trained  for  this  type  of  operation? 

Ai  ^  there  sufflcient  forces  to  offset  anticipated  and  contingency  enemy  reactions? 

Can  the  forces  be  in  position  in  the  timefi  me  identified? 

Do  the  forces  have  sufficient  equ.,  ment? 

Can  we  accomplish  the  mission  with  a  “minimum  footprint”  (minimal  troops,  destruction,  minimum 
area,  etc.)? 

1.1.  Forces  (enemy) 

Can  enemy  forces  be  countered  during  the  operation  minimize  their  impact,  especially  loss-of-life? 

14.  Geography  and  terrain 

Are  the  fr-endiy  forces  trained  to  support  operations  in  this  type  of  area  and  terrwn? 

D  es  the  terrain  /  geography  inhibit  /  facilitate  the  operation? 

Are  beaches  accessible  as  transportation  alternative? 

15.  Lega^  author^ites 

Would  we  be  violatin,^  any  local  or  international  laws  or  treaties  in  conducting  these  operations? 

Will  we  be  co*jrdinating  with  local  peacekeeping  authorities? 
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16.  Maps  and  chart  availability 

Do  we  have  sufficient  information  about  the  local  geography  and  topology? 

17.  Medical  services 

Sufficient  (in  both  quantity  and  type)  medical  facilities  must  be  provided  both  en-route  and  at  each 
safe  haven. 

Medical  units  must  be  available  at  each  of  the  evacuation  centers  in  country. 

18.  Non-combatant  personnel 

Accommodations  (both  transportation,  food,  amd  lodging)  must  be  made  available  for  all  evacuees 
including  both  US  and  other  friendly  nationals  evacuated  by  US. 

19.  Operational  comparison  (US  and  adversary) 

What  activities  might  the  enemy  undertake  to  undermine  our  operation? 

How  susceptible  is  our  operation  to  enemy  activities? 

20.  Reconnaissance  reporting 

Can  we  get  assessments  of  enemy  activities  for  this  operation? 

Can  we  get  information  regarding  the  agencies,  facilities,  and  resources  involved  and  updates  on  that 
status  over  the  course  of  the  operation? 

21.  Rules  of  engagement  (ROE) 

Will  the  operation  be  able  to  be  conducted  within  the  specified  rules  of  engagement? 

22.  Seaports  and  port  facilities 

Are  the  seaports  close  to  the  evacuation  areas? 

Are  the  seaports  capable  of  supporting  the  proposed  evacuation  ship  types? 

Are  the  seaports  capable  of  supporting  the  proposed  ship  quantities? 

Are  there  enough  of  the  right  types  of  staff  available  (refuelers,  sea  traffic  control,  maintenance,  etc.) 
if  necessary? 

Do  the  docks  have  facilities  for  refueling  (only  if  necessary)  or  do  we  need  to  bring  it  in? 

Are  the  docks  capable  of  providing  the  equipment  necessary  to  support  ship  operations  (radios,  etc.)? 

23.  Transportation  (local) 

Is  sufficient  local  transportation  available  for  transport  to  assembly  areas? 

Can  transportation  be  rented  or  purchased  locally  as  opposed  to  provided  by  the  evacuation  forces;' 
Are  the  routes  susceptible  to  enemy  intervention? 

Can  the  local  lines  of  communications  be  protected  during  use? 

The  remadning  16  are  normally  not  a  consideration  during  NEO  operations  but  are  included  here  for 
completeness: 

1.  Construction 

2.  Critical  Assets 

3.  Emergency  Response  Elements 
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4.  Intelligence  Collection  Assets 

5.  Intelligence  Collection  Priorities 

6.  LERTCON  Actions 

7.  Manpower 

8.  Mobilization  (Forces) 

9.  Mobilization  (Industrial  Base) 

10.  National/Regional  Interests  and  Objectives 

11.  Nuclear  Weapons  Accounting 

12.  Political,  Economic,  and  Social  Factors 

13.  Petrol  and  Lubrication  (POL) 

14.  Security  Assistance /Military  Aid  Programs 

15.  Sustainment 

16.  World  Reaction 

Appendix  D  summarizes  additional  NEO  considerations. 


4  Relevant  Logistics  Factors  for  COA  Evaluation 

As  we  described  before,  each  staff  division  produces  evaluations  of  COAs  that  take  into  account  the  factors 
relevant  to  that  division.  For  example,  the  logistics  directorate  (J-4)  is  concerned  with  ensuring  effective 
logistic  support  for  all  forces,  including  transportation,  supply,  and  maintenanr.e  issues.  This  section  describes 
relevant  factors  to  evaluate  COAs  from  a  logistics  perspective  in  more  detail  than  the  previous  section.  The 
main  factors  from  a  logistics  perspective  Me  the  following  five: 


A-PORTS  {Airports)  —  For  each  airport  mentioned  in  COA,  two  aspects  are  evaJuated:  (1) 
number  of  sorties/day,  and  (2)  the  number  of  square  feet  of  aircraft  parking. 

S-PORTS  {Seaports)  —  For  each  seaport  mentioned  in  COA,  the  aspects  considered  are:  (1) 
number  of  piers,  (2)  number  of  berths,  (3)  the  max  size  of  vessels  aJlowed  in  the  seaport  (in  feet), 
and  (4)  number  of  oil  facilities  or  POLs  (petrol  and  lubrication.) 

LOG  PER  {Logistics  Personnef)  —  The  number  of  people  needed  to  support  the  operation. 
Support  peroonnel  includes  unloading  personnel,  stevedores,  and  military  police. 

Closure  Date  {Earliest  deployment  closure  allowed  by  COA)  —  This  is  also  known  as 
the  COA  closure  date,  and  is  given  as  an  offset  from  D-day  (D-t-X). 

LOCs  {Lines  of  Communication) — 'I'his  factor  evaluates  the  operation  in  terms  of  how  the 
dTHeriSt  force  modules  involved  will  be  able  to  communicate  when  they  are  physically  distributed 
in  different  locations.  It  is  usually  qualified  as  good,  ok.  or  bad. 
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•  A-PORTS: 


-  airports 

-  sorties/day 

-  3q  ft  ac  parking 

S-PORTS: 

-  seaports 

-  piers 

-  berths 

-  vessel  size  limitations  in  feet 

-  oil  facilities 

CLOSURE  DATE 
LOG  PERS 
LOCs; 

-  number  locations 

-  miles  max  distance 
--  air  and  sea? 


Figure  1:  Relevant  Logistics  Factors  to  Evaluate  a  COA 


Figure  1  summarizes  these  factors. 

Other  factors  considered  include  resupply  capability  of  aurports  and  seaports  in  terms  of  storage  and 
refrigeration,  pre-poeitioned  war  reserve  material  stock,  covered  storage  areas,  logistics  command  and  control, 
host  nation  support  in  terms  of  resources  allocated  by  host  country  for  the  operation,  rnedicad  services, 
the  logistic  over  the  shore,  whether  ships  are  stacked  up  at  the  seaports  wanting  to  be  unloaded,  onward 
movement  coordination,  oil  facilities  gauncd,  who  is  in  charge  of  C2,  whether  forces  must  move  to  other 
locations,  topography,  C3  physical  protection,  climate  and  weather,  and  enemy  C3CM. 


4.1  Estimating  the  Value  of  Relevant  Factors  for  COA  Evaluation 

The  value  of  most  factors  is  estimated  using  back  of  the  envelope  calculations.  In  summary,  the  five  logistics 
factors  just  described  are  estimated  as  follows: 


A-PQETS:  For  all  the  airports  mentioned  in  COA,  add 

•  number  of  sorties/day  allocat  id  to  the  operation  by  the  host  nation. 

•  aircraft  parking  space  available  (ir.  square  feet). 

S-PORTS:  For  all  the  seaports  mentioned  in  COA,  add 

•  number  of  piers  in  the  seaport. 
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•  number  of  cargo  berths. 

•  maximum  size  of  vessels  allowed  by  the  seaports  of  the  COA  (in  feet).  This  is  calculated 
by  taking  the  maximum  length  of  the  types  of  cargo  berths  available  in  all  the  seaports. 


Closure  Date:  Maximum  of  airlift  and  sealift  closure  times. 

LOG  PER:  The  logistics  peisonnel  needed  is  a  function  of  the  size  of  the  personnel  involved  in 
the  operation.  It  can  be  estimated  as  a  percentage  of  the  people  who  compose  the  non-crganic 
force  modules  involved  in  the  COA.  The  logistics  personnel  is  composed  of  unloading  support 
personnel,  airport  support  personnel,  and  seaport  sup’  ort  personnel. 


LOCs:  There  are  three  relevant  aspects  to  evaluat 

•  number  of  locations 

•  maximum  distance  between  those  locations  (in  miles) 

•  whether  or  not  there  are  both  s'r  and  sea  locations. 


Appendix  B  describes  in  more  detail  how  to  produce  these  estimates. 


5  Comparing  Alternative  COAs 


Cnee  the  factors  relevant  for  the  evaluation  have  been  estimated  for  each  COA,  the  COAs  can  be  compared 
against  each  other  to  produce  a  comparison  matrix.  The  matrix  is  filled  out  with  pluses  and/or  minuses 
depending  on  how  the  alternative  COAs  compare. 

A-PORTS  is  belter  the  more  throughput  they  have,  which  depends  mostly  on  sorties  and  peirking.  S- 
PORTS  is  better  the  more  berths  of  bigger  size  that  they  have.  The  closuie  dale  is  better  the  closer  it  is  to 
the  D  day.  LOG  PERS  is  good  if  it  is  not  a  large  number. 

LOCs  are  compared  as  follows.  If  only  one  geoloc  involved  in  COA,  then  they  are  good.  If  two  geolocs, 
then  they  are  ok.  If  three  or  more  geolocs,  they  are  bad.  It  is  better  if  the  locations  are  close  to  each  other 
and  also  if  they  ue  far  from  the  enemy  border.  It  is  also  good  if  there  are  both  air  and  sea  locations. 

In  general  there  are  tradeoffs  in  these  factors.  For  example,  the  more  ports  in  the  CO/,  the  better  A- 
PORTS  and  S-PORTS,  but  LOG  PERS  increases  and  that  is  not  so  good.  This  is  key  to  give  feedback  to  a 
generative  planner  from  this  avaluation:  to  keep  a  good  value  in  a  factor  while  improving  in  another  one. 


6  Related  Work  within  the  Planning  Initiative 

COATA  and  CO/  ST  are  tools  developed  within  the  Planning  Initiative  that  explore  issues  complementary 
to  what  is  described  in  this  paper  in  their  coverage  of  evaluation  criteria,  the  scope  of  the  work  to  support 
the  creation  of  staff  estimates,  and  the  research  issues  that  they  address. 

COATA  is  a  COA  evaluaticn  tool  developed  at  Rockwell  [9].  The  m^un  focus  of  the  research  at  Rockwell 
is  reasoning  under  uncertainty.  The  uncertainty  in  the  data  is  represented  with  probability  distributions 
used  by  a  decision-theoretical  model  to  evaluate  COAs  against  a  set  of  pre-defined  metrics.  COATA  (Course 
Of  Action  Trade-off  Analyzer)  is  designed  to  provide  an  early,  high-level  trade-off  analysis  among  different 
classes  of  COAs  under  uncertain  conditions.  COATA  concentrates  on  factors  relevant  to  NEO  operations 
from  a  J-3  (operations)  perspective.  This  papers  focuses  on  a  complementary  J-4  (logistics)  perspective. 
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COAST  is  a  COA  selection  tool  developed  at  NRaD  [5].  COAST  produces  a  COA  selection  matrix  based 
on  a  set  of  criteria  chosen  and  ranked  by  the  user  n<'co-ding  to  their  relevance  for  the  situation.  COAST 
does  not  evaluate  the  criteria:  the  user  must  estimate  them  manually  and  enter  the  result.  COAST  takes 
these  manual  evaluations  and  uses  a  weighted-sum  scoring  system  to  rank  the  CO  As.  Like  COATA,  COAST 
also  considers  operational  criteria. 

7  Generating  Qualitatively  Diflferent  Plans:  EXPECT  and  O- 
Plan2 

This  section  describes  our  ideas  to  combine  the  COA  generation  via  0-Plan2  and  the  COA  evaluation 
capabilities  of  EXPECT  within  the  Planning  Initiative.  We  first  present  very  briefly  t!ie  two  systems,  then  we 
show  how  they  can  be  combined. 

7.1  0-Plan2 

The  0-Plan2  Project  at  the  Artificial  Intelligence  Applications  Institute  of  the  University  of  Edinburgh  is 
exploring  a  practical  computer  based  environment  to  provide  for  specification,  generation,  interaction  with, 
and  execution  of  activity  plans.  0-Plan2  is  intended  to  be  a  domain-independent  general  planning  and 
control  framework  with  the  ability  to  embed  detailed  knowledge  of  the  domain.  See  [l]  for  background 
reading  on  planning  systems.  See  [2]  for  details  of  OPlan  (now  referred  to  as  0-PIanl),  the  planning  system 
that  was  a  forerunner  to  the  O  Pian2  agent  architecture.  That  paper  also  includes  a  chart  showing  how 
0-Plan  relates  to  other  planning  systems.  Further  detail  on  0-PlaD2  is  availeible  in  [8]. 

The  overall  0-Plan2  plan  representation  and  system  allows  for  “tasks”  (Missions,  constraints,  resources, 
etc)  to  be  explored  and  compared  in  a  supportive  interface  for  doing  plan  option  analysis.  This  strategic 
“Task  Assignment”  level  gives  more  specific  tactical  requirements  to  the  computer  planner  and  human 
planner  who  vork  with  n.ixed  initiative  alongside  each  other.  Neither  is  “in  charge”  in  our  system  -  they 
both  are  “eduii  g*'  plans  constrained  by  the  mission  options  being  explored  and  the  “authority”  given  to  tl.v-m 
for  planning  or  execution.  Finally,  when  a  COA  to  be  used  as  a  basis  for  operations  is  selected,  operational 
planning  mid  execution  monitoring  support  is  offered  along  with  some  simple  forms  of  plan  repair  to  keep 
things  on  track. 

The  Edinburgh  0-Pian2  prototype  is  currently  being  demonstrated  generating  plans  a  logistics  scenario. 
Work  is  now  underway  for  mid  1994  to  demonstrate  the  0-Plan2  planner  working  with  an  enriched  resource 
model  of  NEO  evacuee  transportation  in  the  PRECiS  domain.  A  later  demonstration  in  1995  is  intended 
to  show  how  plans  can  be  generated  and  their  execution  monitored  and  simple  fixes  apphed  in  the  PRECiS 
domeun. 

7.2  EXPECT 

The  goal  of  the  EXPECT  project  of  the  Information  Sciences  Institute  of  the  University  of  Southern  California 
is  to  provide  an  environment  for  the  development  of  knowledge-based  systems  that  aids  in  the  acquisition, 
maintenance,  and  documentation  of  the  knowledge  about  a  task. 

The  EXPECT  architecture  [7,  3,  4J  is  being  applied  to  producing  staff  estimates  for  tentative  courses  of 
action  to  produce  brlefiiigs  for  a  conimpnder.  To  date,  we  have  a  prototype  system  that  takes  an  assessment  of 
the  situation  and  evaluates  relevant  factors  for  the  alternative  courses  of  action  from  the  logistics  perspective. 
The  system  has  a  map-base  !  interface  that  displays  force  deployment,  and  allows  the  user  to  analyze  factor 
evaluations  through  interactive  dialogues.  The  user  can  correct  the  system’s  kuo^/ledge  about  how  to  compute 
these  evaluations  if  a  knowledge  deficiency  is  detected.  The  user  can  also  correct  the  system’s  knowledge 
base  to  add  new  relevant  factors  or  to  expand  the  level  of  detail  at  which  the  evaluations  are  computed. 


Figure  2:  0-Plan2  and  EXPECT  could  cooperate  to  produce  better  alternatives  for  CGAs. 


7.3  Generating  Qualitatively  Different  Plans 

Figure  2  shows  how  the  two  systems  could  cooperate  to  produce  better  alternatives.  0-Plan2’s  generated 
COAs  are  given  to  EXPECT.  EXPECT  evaluates  these  COAs,  and  gives  feedback  to  O-Plan’s  evaluation 
function  in  terms  of  what  factors  can  be  improved  to  produce  a  better  COA. 

A  higher  level  Mission  Tasking  component  provides  the  framework  within  which  options  are  being  ex¬ 
plored  and  compared. 

The  Advisor  module  would  provide  the  feedback  to  make  a  COA  of  better  quality.  This  feedback  can  be 
at  different  levels  of  detail.  The  more  details,  the  easier  it  is  for  a  generative  planner  to  operationalize  the 
feedback.  For  example,  a  high-level  piece  of  feedback  could  be  “The  airlift  closure  date  needs  to  be  a  day 
earlier,”  while  a  more  detailed  one  would  be  “use  a  bigger  airport.” 
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A  Appendix:  An  Example  Scenario 


<» 


Thu  «^>p«ndix  shows  with  concreU*  examplM  what  arr  tk*  r^flrvant  in|>ul.«  and  outputs  of  thr  various  st^ps  of 
the  development  of  the  concept  of  operations.  The  examples  used  arc  extracted  from  the  PRLtJiS  scenario. 

A.l  Tentative  Courses  of  Action 

Tentative  COAs  are  described  as  a  set  of  elements  composed  of  who/when/what/where  specifications.  These 
correspond  to  a  force  module,  a  time  frame  (a  start  date  and  am  end  date  as  offsets  from  D-day),  an  action, 
amd  a  location. 

The  following  are  the  adternative  COAs  for  the  PRECiS  scenario. 


A.1.1  COA  1  (Delta) 

English  Description; 

On  D  day,  the  M£U^  will  conduct  amphibious  operations  in  Delta  and  the  LIB^  will  aurlamd  in 
Delta.  Starting  on  D-t-2  amd  ending  no  later  them  D-l-5,  the  ACR®  will  begin  unloading  in  Delta. 
Starting  on  D-f5  and  ending  no  later  than  D-1-15,  the  MID^  will  begin  unloading  in  Delta.  The 
MEU  will  reimbark  no  later  than  D+9.  On  D  day,  the  CVBG®  will  MODLOC  near  Baurnacle. 

COA  elements: 


Who 

When 

What 

Where 

MEU 

D  day 

amphibious  ops 

Delta 

LIP 

D  day 

airland 

Delta 

ACR 

start  on  D  4-  2 
end  NLT  D-l-5 

begin  unloading 

Delta 

MID 

start  on  D  -1-  5 
end  NLT  D  -f  15 

begin  unloading 

Delta 

MEU 

NLY  D-l-9 

reimbark 

CVBG 

D  day 

MODLOC 

near  Barnacle 

A.1,2  COA  2  (Calypso) 

English  Description: 


On  D  day,  the  MEU  will  conduct  amphibious  operations  in  Calypso  and  the  LIB  will  airland 
in  Calypso.  Starting  on  D-l-2  and  ending  no  later  than  D-t-5,  the  ACR  will  begin  unloading  in 
Calypso.  Starting  on  D-l-5  and  ending  no  later  than  D-f  15,  the  MID  will  begin  unloading  in 
Calypso.  The  MEU  will  reimbark  no  later  than  D-l-9.  On  D  day,  the  CVBG  will  MODLOC  near 
Barnacle. 


'Marine  Expeditionary  Unit 
^Lijjht  Infantry  Brigade 
*  Armored  Cavalry  Regiment 
‘Mechanjsied  Infantry  Division 
■'CV  Battle  Group 
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CO  A  rleiDfiita: 


Who 

When 

What 

Where 

MEU 

D  day 

amphibious  ops 

Calypso 

LIB 

D  day 

airland 

Calypso 

ACR 

start  on  D  +  2 
end  NLT  D  +  5 

begin  unloading 

Calypso 

MID 

start  on  D  +  5 
end  NLT  D+15 

begin  unloading 

Calypso 

MEU 

NLT  D  +  9 

reimbark 

CVBG 

D  day 

MODLOC 

near  Barnacle 

A. 1.3  COA  3  (Deltii  and  Calypso) 


English  Description; 

On  D  day,  the  MEU  will  conduct  iunphibious  operations  in  Calypso  and  the  LIB  will  airland  in 
Delta.  Starting  on  D+2  and  ending  no  later  than  D+5,  the  ACR  will  begin  unloading  in  Delta. 
Starting  on  D+2  and  ending  no  later  than  D+15,  1  Brigade  of  the  MID  will  begin  unloading 
in  Calypso.  Starting  on  D+5  and  ending  no  later  than  D+J5,  the  rest  of  the  MID  will  begin 
unloading  in  Delta.  The  MEU  will  reimbark  no  later  than  D+9.  On  D  day,  the  CVBG  will 
MODLOC  near  Barna<..le. 


COA  elements: 


Who 

When 

What 

Where 

MEU 

D  day 

amphibious  ops 

Calypso 

LIB 

D  day 

airland 

Delta 

ACR 

start  on  D  +  2 
end  NLT  D  +  5 

begin  unloading 

Delta 

1  Bde  of  MID 

start  on  D  +  2 
end  NLT  D  +  15 

begin  unloading 

Calypso 

rest  of  MID 

start  on  D  +  5 
end  NLT  D  +  15 

begin  unloading 

Delta 

MEU 

NLT  D  +  9 

reimbark 

CVBG 

D  day 

MODLOC 

near  Barnacle 

A. 1.4  COA  4  (Delta  and  Calypso  and  Abyss) 

English  Description: 

On  D  day,  the  MEU  will  conduct  amphibious  operations  in  CaJypso  and  the  LIB  will  airlrind  in 
Delta.  On  D+1,  a  LI  Battalion  will  airland  in  Abyss.  Starting  on  D+2  and  ending  no  later  than 
D+5,  the  ACR  will  begin  unloading  in  Delta.  Starting  on  D+2  and  ending  no  later  than  D+15, 
1  Brigade  of  the  MID  will  begin  unloading  in  Calypso.  Starting  on  D+5  and  ending  no  later 
than  D+15,  the  rest  of  the  MID  will  begin  unloading  in  Delta.  The  MEU  will  reimbark  no  later 
than  D+9.  On  D  day,  the  CVBG  will  MODLOC  near  Barnacle. 
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COA  1 

COA  2 

COA  3 

COA4 

A-PORTS: 

-  airports 

■ 

1 

2 

3 

-  sorties/hr 

165 

480 

580 

-  sq  ft  ac  parking 

eH 

.9 

2.9 

4.4 

S^PORTS; 

-  seaports 

1 

1 

2 

3 

-  piers 

6 

9 

15 

18 

-  berths 

6 

10 

16 

21 

-  max  vessel  size  in  ft 

600 

none 

none 

none 

-  oil  facilities 

1 

2 

3 

4 

CLOSURE  DATE 

D+  15 

D  +  12 

D  +  9 

D  +  9 

LOG  PERS 

3300 

3300 

3800 

4300 

LOCs: 

-  number  locations 

■ 

1 

2 

3 

-  miles  max  distance 

64 

-  air  and  sea? 

yes 

yes 

yes 

Figure  3:  Results  of  the  Evaluation  of  the  Alternative  COAs  from  the  Logistics  Perspective. 


CO  A  elements: 


Who 

When 

What 

Where 

MEU 

D  day 

amphibious  ops 

Calypso 

LIB 

D  day 

airland 

Delta 

LI  Batt 

D+  1 

airland 

Abyss 

ACR 

start  on  D  -F  2 
end  NLT  D  +  5 

begin  unloading 

Delta 

1  Bde  of  MID 

start  on  D  +  2 
end  NLT  D  +  15 

begin  unloading 

Calypso 

rest  of  MID 

start  on  D  +  5 
end  NLT  D  +  15 

begin  unloading 

Delta 

MEU 

NLT  D  +  9 

reimbark 

CVBG 

D  day 

MODLOC 

near  Barnacle 

A. 2  Staff  Estimates 

Stair  estimates  are  presented  as  matrices  of  factors  and  alternative  COAs.  Section  4  describes  how  these 
evaluations  are  produced  based  on  the  description  of  each  COA.  Figure  3  shows  an  example  of  a  logistics 
staff  estimate. 


A, 3  Comparison  Matrices 

Based  on  the  estimate,  each  staff  division  produces  a  comparison  matrix  that  compares  the  alternative 
COAfi.  Section  5  shows  how  these  comparisons  are  constructed.  Figure  4  shows  an  example  of  a  logistics 
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A-PORTS 

f+ 

-1- 

++■+■ 

4-4-4- 

S-PORTS 

•f 

+  + 

4-4-4- 

CLOSURE 

-h-h-l- 

+-h 

+ 

4- 

LOG  PERS 

+ 

-1- 

+/- 

- 

LOCs 

-1- 

4-1- 

+/- 

Figure  4:  Comparison  Matrix  for  Alternative  COAs  from  the  Logistics  Perspective. 


staff  comparison  matrix.  These  comparisons  are  represented  as  pluses  and  minuses.  Based  on  the  data  in 
this  figure,  COA  3  would  probably  be  selected. 


B  Appendix!  Summary  of  Algorithm  for  Evaluating  and  Com¬ 
paring  COAs 

This  is  an  algori.hm  to  compute  gross  estimates  of  COA  factors  relevant  for  logistics  evaluation.  The  COA 
is  given  as  a  set  of  elements  as  described  in  A.l.  The  factors  are  summarized  in  Figure  1. 

1.  Evaluate  A- PORI'S 

The  COA  elements  that  need  airports  are  those  whose  actions  are  airland,  unload,  and  reimbaik.  For 
these  elements; 

s  airports;  add  the  total  number  of  airports 

•  sorties/day;  add  the  host  nation  support  in  sorties  per  day  of  all  the  airports 
s  ac  parking,  add  the  parking  available  for  all  the  airports 

2.  Evaluate  S-PORTS 

The  COA  elements  that  need  seaports  are  those  whose  actions  are  airlsud,  unload,  and  reimbark.  For 
these  elements; 

•  seaports;  add  the  total  number  of  seaports 

•  piers;  add  the  total  number  of  piers 

•  berths’  add  the  total  number  of  ship  berths  in  all  the  seaports  (ship  berths  are  berths  of  type  A 
or  B) 

•  vessel  size  limitations;  maximum  length  of  the  berths  of  all  the  seaports 

•  oil  facilities:  add  the  total  number  of  pole  in  all  the  seaports 

3.  EvaJuate  closure  date  of  COA 

If  detailed  routes  and  movements  are  available,  take  the  maximum  of  the  airlift  closure  and  the  sealift 
closure  dates  ®.  Otherwise,  since  the  sealift  is  usually  the  bottleneck,  the  closure  date  is  estimated  as 
follows; 

*The  procedure  to  calculAte  the  airlift  closure  is  descrioed  in  detail  in  [l3]. 
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(a)  Calculate  the  total  capacity  of  sealift  available;  The  sealift  available  is  given  in  the  JSCP.  For 
each  ship  type  multiply  the  number  available  by  the  capacity  of  the  ship  type. 

(b)  Calculate  total  unloading  time  of  sealift  available:  For  each  ship  type,  multiply  the  number 
available  by  the  minimum  unloading  time  of  that  ship  type. 

(c)  Calculate  the  sea  cargo  of  all  the  non-organic  units  of  the  COA:  Take  80%  of  the  total  cargo  for 
each  army  and  air  force  units. 

(d)  Calculate  how  many  round  trips  arc  necessary:  Divide  the  sea  cargo  by  the  total  capacity  of  sealift 
available. 

(e)  Calculate  the  maximum  time  it  would  take  to  unload;  Multiply  the  number  of  round  trips  by  the 
total  unloading  time  of  the  sealift  available. 

(f)  Calculate  how  much  time  it  would  take  to  unload  given  the  capacity  of  the  seaports  of  the  COA: 
Divide  the  unloading  time  by  the  number  of  ship  berths  in  the  seaports  of  the  COA  (berths  of 
types  A  and  B). 

(g)  Convert  to  days,  and  report  as  an  offset  from  D  day  (i.e.,  D  +  X). 

4.  Estimate  LOG  PER  (Logistics  Personnel) 

(a)  Compute  the  total  personnel  involved  in  the  COA:  Only  the  movement  of  army  and  air  force  units 
is  under  the  logistics  responsability.  Other  types  of  units  are  organic  (they  move  themselves).  Add 
all  the  troops  in  all  the  non-organic  units  mentioned  in  the  COA. 

(b)  Estimate  of  the  unloading  support  personnel;  Take  10%  of  the  total  personnel. 

(c)  Estimate  the  airport  support  personnel;  Take  0.5%  of  the  total  personnel  and  multiply  that  by 
the  number  of  airports. 

(d)  Estimate  the  seaport  support  personnel;  Take  1%  of  the  total  personnel  and  multiply  that  by  the 
number  of  seaports. 

(c)  Add  all  the  support  personnel. 

5.  Determine  LOCs 

•  number  locations  mentioned  in  the  COA. 

•  maximum  distance  between  the  locations:  If  more  than  on^ic  location,  find  distances  between  each 
pair  in  a  table  and  take  the  maximum.  If  only  one  location  with  airport  and  seaport,  estimate 
their  distance  as  20  miles. 

•  are  there  air  and  sea  locations?:  Check  if  there  is  airport  and  seaport  for  each  location  mentioned 
in  COA. 


C  Appendix:  Data  Needed  for  Evaluating  and  Comparing  COAs 

The  COAs  in  Appendix  A  can  be  evaluated  using  the  procedures  described  in  Appendix  B  given  some 
additional  data  about  resources  and  geolocs.  We  provide  here  these  additional  data. 

The  general  data  used  for  this  scenario  are  as  follows: 


-  Data  about  force  modules; 


UNIT 

PERSONNEL 

WTSfZie' 

(stons) 

CARGO 

OVERSIZE 

(stons) 

BULK 

(stons) 

FTSt” 

(mtons) 

LIB 

3005 

93 

1862 

591 

16087 

ACR 

5492 

12905 

13348 

1362 

83250 

MID 

17386 

29747 

46374 

3969 

267923 

-  Data  about  ships: 


1  ship  type 

length 

depth  (draft) 

avg  speed  (knots) 

avg  load  (mtons) 

avg  offload  time 

1  breakbulk 

35 

20.5 

20,874 

5  days 

-  slow 

495 

-  fast 

572 

fast  SS  container 

669 

32 

20.0 

13,881 

35  hours 

lash 

37 

22.5 

42,042 

18  hours 

roro 

34 

38,755 

6  hours 

sea  barge 

39 

20.0 

42,400 

10  hours 

NOTE;  Only  70%  of  the  avg  load  can  be  used  for  cargo  transportation. 
-  Berths  characteristics 


1  berth  type 

length 

depth 

width 

A 

765 

45 

100 

B 

600 

41 

80 

C 

460 

31 

65 

D 

250 

17 

45 

E 

200 

13 

35 

F 

100 

7 

25 

NOTE:  Berths  A  and  B  are  the  only  ones  that  can  accomodate  transport  ships  (due  to  draft 
limitations).  They  are  called  ship  berths. 


Data  specific  to  this  8cen^u'io: 

-  Sealift  available  in  tf  .  JSCP;  20  breakbulk  and  3  containers  SS  Fast. 

-  Units  involved 

♦  MEU  (Marine  Expeditionary  Unit)  (Na\y) 

♦  LIB  (Light  Infantry  Brigade)  (Army) 

♦  ACR  (Armored  Cavalry  Regiment)  (Army) 

♦  MID  (Mechanized  Infantry  Division)  (Army) 

♦  CVBG  (CV  Battle  Group)  (Navy) 

•  Data  on  airports  used  in  CO  A: 


Delta 

Calypso 

Abyss 

hns  in  sorties/day 

315 

165 

100 

ac  parking  in  sq  ft 

2,291,000 

900,000 

150,000 

•  Data  on  seaports  used  in  CO  A: 
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Delta 

Calypso 

Abyss 

Berths  type  A 

•• 

1 

3 

Berths  type  B 

6 

9 

2 

Piers 

3 

3 

4 

Oil  facilities 

1 

2 

1 

•  Road  distances 

-  Calypso  -  Abyss:  208  Km 

-  Calypso  -  Delta:  64  Km 

-  Delta  -  Abyss:  144  Km 


D  Appendix:  NEO  Considerations 

This  Appendix  expands  on  the  NEO  factors  described  in  Section  3- 

In  concept,  an  uncontT''Iicated  NEO  csise  is  one  involving  a  small,  homogeneous  evacuee  population  that 
is  geographic^ally  concentrated;  a  slowly,  linearly-changing  situation;  a  constant  rate  of  evacuee  population 
changes;  a  helpful,  cooperating  host  nation  suid  available,  ready  U.S.  military  capabilities  not  subject  to 
higher  priority  demands.  Such  a  situation  may  not  even  require  military  assistance.  But  even  so,  military 
authorities  will  monitor  the  situation  closely  in  case  of  needed  rapid  adjustment. 

Conversely,  a  complicated  NEO  case  is  that  of  a  large,  geographicalIy-di:>lributed,  heterogeneous  evacuee 
population;  a  rapidly  changing  volatile  situation,  a  varying  rate  of  evacuee  population;  a  hostile,  armed  host 
nation  and  constrained  U.S.  military  capabilities.  According  to  Air  Force  Institute  of  Technology  graduate 
students  doing  research  into  NEO  planning,  the  following  observations  weie  made  and  are  presented  here: 

1 .  Preparation  of  the  commander’s  estimate  may  be  the  most  critical  and  time-consuming  task  of  NEO 
time-sensitive  planning. 

2.  A  NEO  CAT  early  considers  and  analyzes  the  following  four  components  of  the  impending  NEO:  (1) 
the  threat  environment;  (2)  locations  of  non-combatants  to  be  evacuated;  (3)  escape  routes;  and  (4) 
potential  air  and  sea  PODs. 

3.  Information  gathering  is  the  most  important  feature  of  NEO  planning. 

USCENTCOM  provided  the  following  list  of  information  needs  and  sources  for  NEO  planning: 

•  threat  information  (Intel  reports) 

•  noncombatant  data  (EVAC  file,  Orders  and  Plans) 

•  road  network  data  (USNI  DB,  Orders  and  Plans) 

•  airfield  data  (APOKTS  DB,  AFFIS  file) 

•  seaport  data  (PORTS  DB,  AFFIS  file) 

•  US  military  response  force  information  including: 

~  build  forte  size  and  composition  (SORTS) 

-  force  status  and  availability  in  the  AOR  (SORTS) 


-  hoet  nation  logistic  assets  (food,  medicine)  (Orders  and  Plans) 

-  embassy  comm,  capabilities  (Embassy  /DoS  Liason) 

-  force  organization 

•  Maps  (DMA,  JOPES) 

•  Weather  (CAWSS  file) 

•  Hoet  Nation  and  Embassy  site  geography  (GEO  file,  CNCC  file) 

«  Other  information  identified  as  needed 

•  What  is  the  composition  of  the  evacuee  population?  (noncombatants,  tourists,  host  nation  officials) 

«  Where  are  they  located? 

«  What  baggage  and  equipment  needs  to  be  evacuated? 

•  What  APOEe  are  in  the  vicinity? 

•  What  are  the  APOE  capabilities? 

•  What  airlift  assets  are  presently  available  in  the  area  of  responsibility? 

•  What  host  nation  and  contract  transportation  is  available? 

•  What  is  the  capability  relationship  between  available  aircraft  and  the  APODs? 

•  What  is  the  current  state  of  <  verflight  rights? 

«  Where  and  what  are  the  ic^.ermediate  safehavens? 

•  The  threat  environment  (which  in  turn  dictates  the  needs  of  the  extraction  force,  the  rules  of  engage¬ 
ment  (ROE)  for  those  forces,  and  the  timing  of  the  operation). 


18 


References 


[1]  Allen,  J.,  Hendler,  J.  and  Tate,  A.,  Readings  in  Planning,  Morgan- Kaufman n,  1990. 

[2]  Currie,  K.W.  and  Tate,  A.,  0-Plan:  the  Open  Planning  Architecture,  Artificial  Intelligence,  Vol.  51,  No. 
1,  North-Holland,  Autumn  1991. 

[3]  Gil,  Y.  Knowledge  Refinement  in  a  Reflective  Architecture  Proceedings  of  the  Twelfth  National  Confer¬ 
ence  on  Artificial  Intelligence,  Seattle,  WA,  August  1994. 

[4]  Gil,  Y.,  and  Paris,  C.  L.  Towards  Method- Independent  Knowledge  Acquisition.  Knowledge  Acquisition, 
Special  issue  on  Machine  Learning  and  Knowledge  Acquisition,  Volume  6,  Number  2,  June  1994. 

[5]  Larsen,  R.  W.  and  Herman,  J.  S.  COAST:  Course  of  Action  Selection  Tool.  Presented  at  the  1994 
Workshop  of  the  Planning  Initiative,  Tucson,  AZ,  February  1994. 

[6]  Reece,  G.,  Tate,  A.,  Brown,  D.,  and  Hoffman,  M.  The  PRECiS  Environment  Paper  to  the  ARPA/Rome 
Laboratory  Plamning  Initiative  Workshop  at  the  Nation^d  Conference  on  Artificial  Intelligence  (AAAI- 
93),  Washington  D.C.,  USA.  ARPI  Report  ARPA-RL/CPE/ Version  1,  August  1993.  Also  available  as 
Artificial  Intelligence  and  Applications  Institute  Technical  Report  AIAI-TR-I40,  University  of  Edin¬ 
burgh. 

[7]  Swartout,  W.  R.,  Paris,  C.  L.,  and  Moore,  J.  D.  Design  for  explainable  expert  systems.  IEEE  Expert 
6(3):58-fi4.  1991. 

[8]  Tate,  A.,  Drabble,  B.  and  Kirby,  R.,  0-Plang:  an  Open  Architecture  for  Command,  Planning  and 
Control,  in  Knowledge  Based  Scheduling,  (eds.  M.Fox,  M.  and  M.Zweben),  Morgan  Kaufmann,  1994. 

[9]  White,  J.  NEO  Course  Of  Action  Analysis  Decision  Model.  Technical  Memorandum  number  136,  Rock¬ 
well  International,  Palo  Alto  Laboratory,  CA  1994, 

[10]  JOPES  Planning  Policies  and  procedures  Vol.  1,  Appendic  C,  Criteria  for  the  Evaluation  of  Military 
Options  and  Courses  of  Action. 

[11]  Armed  Forces  Staff  College,  Pub  1.,  The  Joint  Staff  Officer's  Guide,  1991. 

[12]  Rear  Admiral  Vernon  E.  Clark,  address  to  the  participants  of  the  1992  DRPI  Meeting.  San  Antonio, 
TX,  1992. 

[13]  Air  Force  Pamphlet  76-2,  Airlift  Planning  Factors,  1987. 


19 


